ON THE PROOF COMPLEXITY OF DEEP INFERENCE 
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Abstract. We obtain two results about the proof complexity of deep inference: 1) deep- 
inference proof systems are as powerful as Frege ones, even when both are extended with 
the Tseitin extension rule or with the substitution rule; 2) there ai'e analytic deep-inference 
proof systems that exhibit an exponential speedup over analytic Gentzen proof systems 
that they polynomially simulate. 



1. Introduction 

Deep inference is a relatively new methodology in proof theory, consisting in deal- 
ing with proof systems whose inference rules are applicable at any depth inside formulae 
I Gug07b) . We obtain two results about the proof complexity of deep inference: 

• deep-inference proof systems are as powerful as Frege ones, even when both are 
extended with the Tseitin extension rule or with the substitution rule; 

• there are analytic deep-inference proof systems that exhibit an exponential speed- 
up over analytic Gentzen proof systems that they polynomially simulate. 

These results are established for the calculus of structures, or CoS, the simplest formal- 
ism in deep inference | Gug07b| , and in particular for its proof system SKS, introduced 
by Briinnler in IIBru04l and then extensively studied IIBru03al IBru03bl IBru06al IBru06dl 
IBG04llBT0n . 

Our contributions fit in the following picture. 
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f indicates that formalism ^ polynomially simulates formalism ! 
indicates that it is known that this does not happen. 



The notation ,^ — 
the notation ^ -x- 

The left side of the picture represents, in part, the following. Analytic Gentzen systems, 
i.e., Gentzen proof systems without the cut rule, can only prove certain formulae, which 
we call 'Statman tautologies', with proofs that grow exponentially in the size of the for- 
mulae. On the contrary, Gentzen systems with the cut rule can prove Statman tautologies 
by polynomially growing proofs. So, Gentzen systems p-simulate analytic Gentzen ones. 
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but not vice versa IISta78l . Cook and Reckhow proved that Frege and Gentzen systems 
are polynomially equivalent, i.e., each Frege system polynomially simulates any Gentzen 
system and vice versa IICR74I . 

In the box at the right of the figure, 'extension' refers to the Tseitin extension rule, 
and 'substitution' to the substitution rule. The works of Cook and Reckhow IICR79I and 
Krajfcek and Pudlak IIKP89I estabUshed that Frege + extension and Frege + substitution 
are polynomially equivalent. It is immediate to see that these formalisms polynomially 
simulate Frege and Gentzen, which, in turn, polynomially simulate analytic Gentzen. It is 
a major open problem to establish whether Frege polynomially simulates Frege + exten- 
sion/substitution. 

In this work, we establish the following results (numbered as in the previous figure): 

( 1 ) Analytic Gentzen does not polynomially simulate analytic CoS (essentially in the 
form of system SKS without cut); in fact, Statman tautologies admit polynomially 
growing proofs in analytic CoS (Theorem l3.12b . 

(2) CoS and Frege are polynomially equivalent (Theorems l4.7l and l4. 12b . 

(3) There is a natural notion of (Tseitin) extension for CoS, and CoS + extension is 
polynomially equivalent to Frege + extension (Theorem l5.6b . 

(4) There is a natural notion of substitution for CoS, and CoS + substitution polyno- 
mially simulates CoS + extension (Theorem l5.12b . 

(5) Frege + substitution polynomially simulates CoS + substitution; this way, we 
know that all extended formaUsms are polynomially equivalent (Theorem l5.14b . 

The polynomial simulations indicated by ■*• arcs in the picture follow from the others. 

Establishing whether analytic CoS polynomially simulates CoS is an open problem. 

After the necessary preliminaries, in Section [2] we see how CoS expresses Gentzen 
systems, including their properties, like analyticity, and then in Section[3]how it provides 
for exponentially more compact proofs. The relation between CoS and Frege systems is 
explored in Section |4] and the extensions are studied in Section |5] We conclude the article 
with a list of open problems, in Section |6l 

2. Preliminaries 

In this section, we quickly introduce the necessary deep-inference notions. A more 
extensive treatment of much of this material is in Briinnler's IIBru04l . 

We only need the following, basic proof complexity notions (see IICR79I ). 

Definition 2.1. A {propositional) proof system is a binary relation S between formulae 
a and proofs Tl such that S is computable in polynomial time, and the formula a is a 
tautology if and only if there is a proof 11 such that S{a, 11); in this case we say that 11 is 
a proof of a in S. We say that proof system S p-simulates proof system S' if there is a 
polynomial-time computable algorithm that transforms every proof in S' into a proof in >S 
of the same tautology. Two proof systems are p-equivalent if each p-simulates the other 

Remark 2.2. In the following, we state theorems on the existence of proofs in one proof 
system when proofs exist in another proof system, such that their size is polynomially 
related. Implicitly, we always mean that the new proofs are obtained by transforming the 
old ones by way of a polynomial-time computable algorithm. 

Deep inference is a relatively recent development in proof theory. Its main idea is 
to provide a finer analysis of inference than possible with traditional methods, and one 
of the main objectives is to obtain a geometric semantics for proofs, inspired by linear 
logic's proof nets IIGir87l . Another objective is to provide a uniform and useful syntactic 
treatment of several logics, especially modal ones, for which no satisfactory proof theory 
existed before. 

In deep inference, several formalisms can be defined with excellent structural proper- 



ties, like locality for all the inference rules. The calculus of structures | Gug07b) is one 
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of them and is now well developed for classical IBriiOSa', 'Bru06a' 'Bru06d! IBTOll . intu- 
itionistic IITiu06al . linear IIStr02l IStr03bl . modal liBru06c GT07 Sto07.| and commuta- 
tive/noncommutative logics |Gug07b| ITiu06bl IStr03al IBm02l lDG04l iGSOTl lGS02l lGS09l 



IKah06bl IKahOTI : for all these logics, quantification can be defined at any order We em- 
phasise that deep inference is developing the first reasonable proof theory for modal logics; 
the large number of different modal logic systems can be studied in simple and modular 
deep-inference systems, which are similar to their propositional logic counterparts and en- 
joy the same locality properties. The calculus of structures promoted the discovery of a 
new class of proof nets for classical and hnear logic ILSOSal ILS05bl ILS06I ISL04II (see 
also IIGui06l ). Moreover, there exist implementations in Maude of deep-inference proof 
systems IKahOSI . 

In this article, we focus on the calculus of structures because it is well developed and is 
probably the simplest formalism definable in deep inference. The complexity results that 
we present here are not dependent on the choice of formalism; rather, they only depend on 
the deep-inference methodology and the finer granularity of inference rules that it yields. 
Adopting deep inference basically means that it is possible to replace subformulae inside 
formulae by other, implied subformulae, and that there is no limit to the nesting depth of 
subformulae. Formahsms like Gentzen's sequent calculus differ because they only rewrite 
formulae, or sequents, around their root connectives, and (we argue) they suffer excessive 
rigidity in the syntax and they do not sufficiently support geometric semantics. 

Because of its geometric nature, it is important, in deep inference, to control whether 
propositional variables can be instantiated by formulae. In particular, normalisation (cut 
elimination) in deep inference crucially depends on the availability of 'atomic' inference 
rules, which are rules related to some topological invariants (see, for example, IIGG08I 
for normalisation in propositional logic). In practice, we need two kinds of propositional 
variables: the atoms, only subject to renaming, and the formula variables, subject to (unre- 
stricted) substitution. This distinction does not bear dramatic effects on proof complexity, 
but it does allow for some finer measures than otherwise possible. 

Definition 2.3. Formulae of the calculus of structures, or CoS, are denoted by a, j3, y, 6 
and are freely built from: units, like f (false) and t (true); atoms a, b, c, d and a, b, c, d\ 
(formula) variables A, B, C, D and A, B, C, D; logical relations, like disjunction [a v jS] 
and conjunction {a a jj). A formula is ground if it contains no variables. We usually omit 
external brackets of formulae, and sometimes we omit dispensable brackets under associa- 
tivity. We use = to denote literal equality of formulae. The size \a\ of a formula a is the 
number of unit, atom, and variable occurrences appearing in it. On the set of atoms, there 
is an involution ", called negation {i.e., ~ is a bijection from the set of atoms to itself such 
that a = a); we require that a f a for every a; when both a and a appear in a formula, 
we mean that atom a is mapped to a by ~. An analogous involution is defined on the set of 
formula variables. The {De Morgan) dual of a formula is obtained by exchanging disjunc- 
tion and conjunction and applying negation to all atoms and variables; we denote duals by 
using "; for example, the De Morgan dual of a = t v (a a [B v c]) is s f a [a v (B a c)]. A 
context is a formula where one hole { ] appears in the place of a subformula; for example, 
A V (fe A { )) is a context; the generic context is denoted by ^{ ). The hole can be filled with 
formulae; for example, if f { } s /j a [{ ) v c], then ^{a} = a [« v c], ^{b] s a [^7 v c] and 
^{a A B) = /7 A [(fl A B) V c]. The size of ^{ ) is defined as |^{ )| = \^{a}\ - 1. 

Remark 2.4. We do not say that a is positive and a is negative. It only matters that, 
when a and a appear in the same formula, if one is negative the other is positive. In 
absence of disambiguating information, there are two ways in which ^{b} might correspond 
to A [fe V c]: one such that ^{a] s a a [/? v c] and another such that ^{a] s a [a v c]. 



The language of formulae is redundant because we can choose whether to use atoms 
or formula variables whenever a propositional variable is needed. The distinction between 
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atoms and formula variables only plays a role in the choice of applicable inference rules, 
and this aspect is controlled by renamings and substitutions. 

Definition 2.5. A renaming is a map from the set of atoms to itself, and is denoted by 
{ailb\,a2lb2, ■■■]', we use p for renamings. A renaming of ff by p - [a\lb\,a2lb2, ■ ■ ■} 
is indicated by ap and is obtained by simultaneously substituting every occurrence of a,- 
in a by bi and every occurrence of a, by I?, ; for example, if a = a a [/? v (a a [a v C])] 
then a{a/b,b/c} = I? a [c v (I? a [^7 v C])]. A substitution is a map from the set of for- 
mula variables to formulae, denoted by {Ai//3i,A2//32, ■■■}', we use cr for substitutions. 
An instance of a by cr - {Ai//3i,A2//32, . . . ) is indicated by acr and is obtained by si- 
multaneously substituting every occurrence of variable A, in a by formula /3, and every 
occurrence of A, by the De Morgan dual of fSf, for example, if or s (A a [A v A]) v b then 
a{A/(c A B)} = ((c A B) A [(c a B) v [c v B]\) v b. 

a 

Definition 2.6. A CoS (inference) rule v is an expression v — , where formulae a and fi 

P y a 

are called premiss and conclusion, respectively. A (rule) instance v — ofv — i& such that 

y = apcr and 6 = Ppcr, for some renaming p and substitution cr. For some context ^{ }, a 

a y ^[y] 

CoS (inference) step, generated by rule v — via its instance v —, is the expression v 

t t t 

Example 2.7. Given ij and aii -, then ij = — — is an instance of iX and 

A V A fl V fl (A A /?) V [A V fo] 

t A vA 
V is an instance of both ij, and aij,. The rule ci generates the inference step 

b-^ b A 

[fl V A [(c A D) V (c A D)] 

ci . 

[fl V Z?] A (C A D) 

We usually classify deep-inference rules in three classes. For this, we rely on the notion 
of linearity, which, in this context, essentially means the same as in term-rewriting: a 
rewriting rule is linear if variables appear once in both sides of the rule. In other words, a 
linear rule does not create or destroy anything. These are the three classes of rules; 

(1) Atomic rules. They usually correspond to structural rules in Gentzen systems; in 
normalisation and in semantics of proofs, they play a crucial role because they 
express the causality relations between atoms, so shaping the geometry of proofs. 
Their instances are obtained by renaming. 

(2) Noninvertible linear rules. They usually correspond to logical rules in Gentzen 
systems. Since they are noninvertible, they express proper inference choices, but 
since they are linear, they do not alter the geometry of causality between atoms. 
Their instances are obtained by substitution. 

(3) Invertible linear rules. These rules are equivalences between formulae that do not 
correspond to proper inference choices and have no impact on the geometry of 
proofs. For this reason, they are usually gathered into one big equivalence relation 
between formulae, corresponding to just one rule, defined via substitution. 

The success of deep inference is due to its ability to separate rules into classes 1 and 
2, which is only possible by adopting deep inference. The references to the 'geometry of 
proofs' can be understood by reading IIGG08I ILS05bl . Class 3 allows us to greatly simpUfy 
proofs and to hide, so to speak, a great deal of logical complexity (in the sense of size of 
proofs). We start by defining our 'class 3' rule, the others being dependent on specific 
proof systems. 
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Commutativity 



Units 



Associativity 



a V/? =yS V a 



a V f = or 
a a \ - a 
tvt = t 
f Af = f 



[q- V /?] V y = a V V y] 
(a a/3) Ay - a a(JS Ay) 



Context closure 



Figure 1 . Equality = on formulae. 



Definition 2.8. The equality relation = on formulae is defined by closing the equations in 
Figure[T]by reflexivity, symmetry, transitivity and by applying context closure. We define 

a 

the inference rule = as = — , where a - B. 

P 

The following remark helps in assessing how much complexity is hidden in -. 

Remark 2.9. It is possible to decide a - fi m polynomial time by reducing a and yS to 
some canonical form and comparing the canonical forms. A canonical form under = of 
any given formula can be obtained, for example, by removing as many units as possible 
and ordering units, atoms, and variables according to an arbitrary order; the canonical 
form is normal for associativity and units equations, when these are orientated from left 
to right. Let us assume a total order on the set of units, atoms, and variables; we now 
see in detail how to find an equivalent canonical formula in the case of a formula only 
containing one logical relation. On the formula, use commutativity until the minimal unit, 
atom, or variable appears in the leftmost position, then use associativity, orientated from 
left to right, until normality is reached. For example, on [Z? v ^f] v [c v a], we perform the 
steps 

[fe V t/] V [c V a] ^ [c V fl] V [fe V t/] [fl V c] V [ii V t/] fl V [c V [fe V £/]] 

This phase requires 0(n) steps, where n is the size of the formula. We proceed the same 
way on the subformula immediately following the first element, and so on recursively; for 
example, 

fl V [c V [/7 V ^f]] ^ fl V [[/7 V ^f] V c] ^ fl V [^7 V [^f V c]] ^ fl V [^7 V [c V ^f]] . 

The number of steps of the algorithm for a formula only containing one logical relation is 
then 0(«~). On a generic formula, the same algorithm can be used, with the same number- 
of-steps complexity 0(«^) on the size n of the given formula, by adopting the lexicographic 
order induced by the given total order This is an example, also involving an initial 0(«) 
phase of simplification of units: 



(t A t) A [[a V {[[b V t/] V [c V a\] a [[B v c] v [t v a]])] v f] 
t A [[a V {[[b V ^f] V [c V a]] a [[B v c] v [t v a]])] v f] 
{{a V {[[b V ^f] V [c V a\] a [[B v c] v [t v a]])] v f] a t 
[fl V {[[b V V [c V a\] A [[B V c] V [t V a]])] v f 
fl V {[[b V V [c V a\] A [[B V c] V [t V a]]) 

^* fl V {[a V [Z7 V [c V d]]] A [[B V c] V [t V a]]) 
^* fl V {[a V [/7 V [c V d]]] A [t V [a V [c V B]]]) 
fl V ([t V [a V [c V B]\] A [a V [fe V [c V d]]]) 



6 



PAOLA BRUSCOLI AND ALESSIO GUGLIELMI 



^ ([t V [a V [c V B]]] A [fl V [fe V [c V d]]]) v a . 

This way we obtain a (unique, of course) canonical formula in 0(«^) steps, given any 
formula of size n, so we can decide the equivalence of two formulae a and p in O(n^) 
steps, where n = \a\ + \/3\. Notice that at each step the size of the formula stays the same or 
diminishes. 

Definition 2.10. A CoS (proof) system is a finite set of inference rules. A CoS derivation 
O of length k in proof system S, whose premiss is and conclusion is a^, is a chain of 
inference steps 

Vl — 

ai 
V2 — 

<D = : , 

Vk-l 

Vk 

ak 

such that Vl , . . . , v,t is a sequence of inference rules that alternate between the = rule and 

any rule of system S, where k > 0. The same derivation can be indicated by o || s, when 

ak 

the details are known or irrelevant; a proof is a derivation whose premiss is t. A derivation 
is ground if it contains no variables. Sometimes, we omit to indicate the inference steps 
generated by =. The size \<S>\ of derivation O is the number of unit, atom, and variable 
occurrences appearing in it. We denote by ^{O) the result of including every formula of 
<S> into the context ^{ }. We denote by Op and Oct the expression obtained from O by 
applying renaming p and substitution cr to every formula in O. A CoS proof system that, 
for every valid implication a^fi, contains a derivation with premiss a and conclusion /3, is 
said to be implicationally complete. 

Remarli 2.11. If <I> is a derivation, then ^{O}, <t>p, and <J>cr are derivations, for every context 
f { }, renaming p, and substitution cr. 

We use the notion of groundness to relate the complexity of deep-inference proof sys- 
tems with atomic rules to proof systems without atomic rules, including those outside of 
deep inference. Due to the aforementioned redundancy in the language, groundness is not 
really a restriction. 

Remarls 2.12. Every nonground derivation can be transformed into an equivalent, 
ground one, by replacing variables with atoms in such a way that newly introduced atoms 
are different from the already present one. 

We can now define some deep-inference proof systems. System SKS is the most impor- 
tant for the proof theory of classical logic, because of its atomic structural rules. System 
SKSg relates SKS to proof systems in other formalisms, like Frege. 

Definition 2.13. CoS proof systems KSg = {ij,, wi,ci,s), SKSg = KSg U {iT,wT, 
cT}, KS = {aii,awi,aci,s, m} and SKS = KS U {ait, awt, act) are defined in Figures |2] 
and [3] for a language containing f, t, disjunction, and conjunction. Proof systems where 
none of the rules if, aif, wf, and awt appear are said to be analytic. 
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Structural rules 



Logical rule 



SKSg 



it- 



AaA 



f 



comteraction 
or cut 



t 



A vA 
interaction 
or identity 



A 

wT — 
t 

coweakening 



f 

wi — 

A 

weakening 



AaA 
cocontraction 

A vA 
contraction 



A A [B V C] 
' (A A B) V C 



KSg 



Figure 2. Systems SKSg and KSg. 



Atomic structural rules 



Logical rules 



SKS 



ait ■ 



a f^a 



comteraction 
or CMf 



aii ■ 



t 



a V a 
interaction 
or identity 



act ■ 



awt — 

t fl A a 

coweakening cocontraction 



awi — 

fl 



aci 



a V a 



weakening contraction 



A A [B V C] 
' (A A B) V C 
switch 



m ■ 



(A A B) V (C A D) 
[A V C] A [B V D] 
medial 



KS 



Figure 3. Systems SKS and KS. 



Example 2.14. This is a valid derivation in all CoS proof systems defined previously (and 
it plays a role in the proof of Lemma B.llI ): 

7 ^ [(([« V a] A c) A (O' A d)) V (5] 

y V [(((a A ^f) A c) A [a V a]) v 5] 

s 1 ■ 

7 V [[(((Q' a ^f) a c) a a) V a] V 5] 

[a V y] V [((q' a c) a (a a d)) V 5] 

Note that SKSg, KSg, SKS, and KS are closed under renaming and substitution (see 
Remark l2.11l ). This is so because of the distinction between atoms and formula variables. 
Obtaining the closure of these and other systems under renaming and substitution is one of 
the main technical reasons for distinguishing between atoms and variables. 

The following theorem is proved in IIBru04L and follows immediately from Section lTTl 
where we prove that CoS systems p-simulate Gentzen systems. 

Theorem 2.15. (Briinnler) Systems SKSg, KSg, SKS, and KS are complete; systems 
SKSg and SKS are implicationally complete. 

The theorem holds also when restricting the language to ground derivations, since sys- 
tems SKS and KS apply to them. 

In the presence of cut, the coweakening and cocontraction rules do not play a major role 
in terms of proof complexity; 

Theorem 2.16. Systems SKSg and KSg U it are p-equivalent, and systems SKS and KS U 
ait are p-equivalent. 
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Proof. Observe that the rules wt and cT can be derived in KSg U it: 



A At 



AA[fvt] ij, — _ _ 

S ^^ ' Aa[[AvA] v(AaA)] 

(A A f) V t s = — = 

wi z and (A A [A V A]) v (A a A) 

(A A A) V t ci = 

it — (A a A) V (A A A) 

fvt if 

= fv(AAA) 

t = — 

A aA 



Similar constructions hold in KS U it for awt and act- 



It turns out that all the systems mentioned in the previous theorem are p-equivalent, as 
a consequence of Corollarv l2.23l 

Analytic systems are formally defined in Definition 12 . 1 3 1 for CoS, and l3.2l for Gentzen. 
Those definitions are specific to diff'erent systems in different formalisms, which is not 
necessarily satisfactory. Defining a general, syntax-independent concept of analyticity is a 
subject of ongoing research (see Problem l6.4b . We briefly discuss now the notion of ana- 
lyticity and its connections with the proof complexity of deep inference, as an introduction 
to our result on Statman tautologies. 

A Gentzen system is said to be analytic when it does not contain the cut rule. Analytic 
Gentzen systems enjoy the 'subformula property', /.e., proofs in these systems only contain 
subformulae of their conclusions. In fact, we might stipulate that enjoying the subformula 
property is a primitive notion of analyticity, which we can use to exclude the cut rule, as 
desired. In analytic Gentzen proofs, all formulae have lower or equal complexity than 
that of the conclusion, when complexity is measured, for example, as the and/or depth of a 
formula {i.e. , the number of alternations of conjunction and disjunction; see Definition l6.3l ). 
There is another property, of interest to us, that analytic Gentzen systems enjoy: given an 
inference rule and its conclusion, there are only finitely many premisses to choose from; 
we call such rules 'finitely generating'. The cut rule in Gentzen does not possess the 
subformula property nor is it finitely generating. 

The primitive notion of analyticity that we are currently adopting for CoS is different 
from the one for Gentzen. We stipulate that a rule is analytic if its premiss is a formula 
obtained from a formula scheme by instantiating it with subformulae of the conclusion 
(so, the premiss is not just a subformula of the conclusion). This means that no atom or 
variable can appear in the premiss of an analytic rule that does not appear in its conclusion. 
It is, of course, a weaker condition than asking for the subformula property of Gentzen 
systems, but doing so is necessary if we want to adopt deep inference and obtain linear 
rules. Like the subformula property does for Gentzen, this weaker notion for CoS excludes 
the cut rule, but also the coweakening one. However, this is not an important difference 
with the sequent calculus because coweakening is irrelevant for the proof complexity of 
a CoS system (see, for example IIGG08II ). The reason for dealing with coweakening is 
that, given the potential importance of cocontraction for proof complexity, we preferred to 
introduce top-down-symmetric CoS systems (so, closed by duaUty), even if coweakening 
and cocontraction are not required for completeness. 

So, the two notions of analyticity, for Gentzen and for CoS, are such that the only 
important rules that are not analytic are the respective cut rules. Note that in both cases, 
analytic systems are made of finitely generating rules. However, there is an important 
difference: in CoS, the complexity of formulae in an analytic proof can be unboundedly 
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greater than the complexity of the conclusion. Consider, for example, the derivation 

C V (a A V [c V (fl A b)]) 

s 

c V [(a A fe) V [c V (a A b)]] 

[c V (a A b)] V [c V (a A b)] 
ci 

c V (a A /;) 

The and/or depth of the conclusion is 1, while that of the premiss is 3. We could repeat the 
construction on top of itself and further increase the and/or depth of the premiss at will. 

Deep-inference systems can be top-down symmetric in the sense that a derivation can 
be flipped upside-down and negated and still be a valid derivation (we say that two such 
derivations are dual). Accordingly, some forms of analyticity can be defined in a symmetric 
way. Then, typically asymmetric theorems that depend on the notion of analyticity, like 
cut elimination, can be generalised to symmetric statements that imply cut elimination. 
This is not the place to be detailed about this aspect; suffice to say that we can obtain for 
CoS systems much stronger normalisation (and cut elimination) results than for Gentzen 
systems (see OBrU06bllGG08l ). 

As we see in Section ITTl analyticity in CoS faithfully captures analyticity in Gentzen, 
in the sense that analytic CoS can produce isomorphic proofs to Gentzen ones (almost 
amounting to a change of notation). However, analytic CoS admits more proofs than an- 
alytic Gentzen, and, among CoS proofs, we can find some remarkably small ones, which 
analytic Gentzen cannot express; this is the subject of Section [T2] on Statman tautologies. 

Remark 2.17. The rules of SKS are local, in the sense that, for any language with a 
finite number of atoms, checking that a given expression is an instance of any of these 
rules requires time bounded by a constant (adopting a tree representation of formulae, 
for example). This property is peculiar to deep inference; it cannot be obtained in other 
formalisms. For example, a traditional, nonatomic contraction rule is not local because 
it requires checking the identity of two unbounded formulae. Contrary to other nonlocal 
rules, like identity in a Gentzen system, contraction cannot be replaced by its local, atomic 
counterpart without losing completeness. A counterexample showing this is in IIBru03bl . 
Locality can possibly lead to a new, general, productive notion of analyticity, as argued in 
Problem |6H 

We conclude the section by showing the p-equivalence of systems with atomic rules to 
systems without atomic rules. We start by proving the result on ground derivations. 

t ; 

Lemma 2.18. For every ground instance \i there is a derivation a> (aij„s| and for 

a V a 

a V a 

a A a 

every ground instance if there is a derivation o |j |aiT,s); in both cases |<J>| € 0{n-), 

where n — \a\. f 

Proof. Let us see the case for if, the other being its dual. We make an induction on the 
structure of a. The cases when a is a unit or an atom are trivial: in the former case O 
consists of an instance of = and in the latter the instance of if is also an instance of ait. We 
only have to consider the case when a = y: we apply the induction hypothesis on the 
derivation 

_ [/6 V y] A (j6 A y) 

(ygA l^vy]) Ay 

S — z 

[(ySA^) vy] Ay 

It 1 , 

[f V y] A y 
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and we obtain a derivation whose length is 0(n), and so its size is 0(«^), where n = \a\. n 

f ; 

Lemma 2.19. For every ground instance wX — there is a derivation o (awj„s| and for 

every ground instance wt — there is a derivation a> (awT.s); in both cases \<t>\ e 0(n"'), 
where n = \a\. ^ t 

Proof. The proof is similar to the one for Lemma 12.181 In case a = \ an instance of wX 
yields 

f 



f A[f Vt] 

s ■ 



(f A f) V t ' 
t 

we can do similarly if a s f in an instance of wf. These are the derivations for the inductive 
cases about wX (those about wf are dual); 

f f 

wX— = — 

y TAT 

= and wX . 

f V y f A y 

wX wX 

yS V y y8 A y 

From these we obtain a derivation whose length is 0(n), and so its size is 0(«^), where 
n - \a\. □ 

Remark 2.20. In the statement of Lemma 12. 191 instead of {awX, s) and {awf, s} we could 
have used jawX, m) and {awt, m), respectively. 

a V a 

Lemma 2.21. For every ground instance cX there is a derivation <s> laci.m) and for 

a „ 

a 

every ground instance ct there is a derivation o | (acT.m); in both cases |<t>| e 0(« ), 

where n - \a\. a a a 

Proof. The proof is similar to the one for Lemma [2. 181 These are the derivations for the 
inductive cases about cX (those about ct are dual): 

[jS V y] V [j6 V y] (yS A y) V (jS A y) 

= m 

[/?v/3] V [y vy] , l^v/?] A [y vy] 

cX and cX . 

V [y V y] , /3 A [y V y] 

cX cX 

y6 V y ^ y 

From these we obtain a derivation whose length is 0(«), and so its size is 0(n~), where 
n - \a\. □ 

Theorem 2.22. For every ground SKSg derivation C) there is a ground SKS derivation 
O' with the same premiss and conclusion of <I>; ifn is the size of O then the size of is 
O(n^); moreover, if (t> is in KSg then O' is in KS. 

Proof. The theorem follows immediately from Lemmas 12.181 12.191 and l2.21l □ 

By Remark l2.12l every derivation can be 'grounded', so: 
Corollary 2.23. KS and KSg are p-equivalent and SKS and SKSg are p-equivalent. 
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0,A A,(/r 

cut 

cut 

4> (f>,A,A 4>,A,B (f>,A B,il/ 

id — - t — w c V A 

A,A t (p,A (f>,A 4),A'vB 4),AaB,i// 

identity true weakening contraction disjunction conjunction 



Figure 4. System Gentzen. 



Remark 2.24. Sometimes, we use nonatomic structural rule instances in SKS and KS 
derivations: those instances actually stand for the SKS and KS derivations that would 
be obtained according to the proofs of Lemmas 12.181 12.191 and 12.211 In this sense, we 
say that ii, it, wX, wt, cj,, and ct are 'macro' rules for SKS and KS. The reason we 
might want to work with macro rules in SKS and KS instead of working in SKSg and 
KSg and then appeaUng to Theorem l2.22l is to obtain finer upper bounds. This is because 
the size of formulae over which nonatomic structural rules operate can be much smaller 
than the square root of the size of a derivation, which is the pessimistic assumption of 
Theoi'em l2.22l 

Remark 2.25. All implicationally complete CoS proof systems are p-equivalent. This can 
be proved analogously to, or resorting to, a similar 'robustness' result for Frege systems 
("Theorem l4.2l ). as argued in Remark l4.13l This means that studying proof complexity for 
SKSg and SKS has universal value for all CoS systems for propositional logic. 

3. Calculus of Structures, Gentzen Proof Systems and Statman Tautologies 

There are two parts in this section. In the first part, we show how CoS naturally p- 
simulates Gentzen systems, and in particular how it realizes Gentzen's notion of analyticity. 
In the second part, we show that analytic CoS admits polynomial proofs when analytic 
Gentzen only has exponential ones, in the case of Statman tautologies. 

3.1. Calculus of Structures and Gentzen Proof Systems. In this section, we adopt a 
specific one-sided (Gentzen-Schiitte) sequent system that we call Gentzen (and that is 
called GS1p in IITS96I ). We could have adopted any other style of presentation without 
affecting our results. In fact, for Gentzen systems an analogous 'robustness' theorem to 
that for Frege systems (Theorem I4.2l i can be established. This means that studying the 
proof complexity of Gentzen has universal value for the class of Gentzen systems. 

Definition 3.1. Over the language of SKS formulae, the sequent-calculus proof system 
Gentzen is defined by the inference rules in Figure S] where (f) and \jj stand for multisets 
of formulae and the symbol ',' represents multiset union. We interpret multisets of for- 
mulae as their disjunction (where associativity is irrelevant). Derivations, denoted by A, 
are trees obtained by composing instances of inference rules; the leaves of a derivation are 
its premisses and the root is its conclusion; a derivation A with premisses ^i, .. ., (pi, and 
conclusion i/r is denoted by 

<f>i ... 4>h 



A derivation with no premisses is a proof. The size |A| of derivation A is the number of 
unit, atom, and variable occurrences appearing in it. In the following, every SKS formula 
is translated into a Gentzen formula in the obvious way, and vice versa; in particular, we 
translate a Gentzen multiset <p - ai, . . . ,ait into ai v • ■ • v a,,. 
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In the language, we keep the distinction between atoms and variables because, thanks 
to atoms, we obtain a better upper bound for the size of Statman tautologies proofs, in 
the Section [3721 As we said in the case of CoS, the redundancy in the language has no 
consequences outside of the possibility of using certain CoS rules instead of others. 

Deflnition 3.2. The proof system analytic Gentzen is proof system Gentzen without the 
cut rule; analytic derivations and proofs are those derivations and proofs in Gentzen where 
no instances of the cut rule appear. 

We know, of course, that both Gentzen and analytic Gentzen are complete, and that 
Gentzen proofs can be transformed into analytic Gentzen proofs by a cut-elimination 
procedure, which, in general, blows-up a given proof exponentially. 

Every Gentzen derivation has natural counterparts in CoS: the idea is to (arbitrarily) 
sequentialise its tree structure. This is possible because the natural logical relation between 
tree branches is conjunction, which CoS can represent, of course. In doing so, we pay 
in terms of complexity because the tree structure is less redundant than CoS contexts: 
the size of derivations grows quadratically. Other deep-inference formalisms (currently 
under development, see IB LOS I [Gug04[ [Gug05 [ ) are more efficient than CoS and Gentzen 
formalisms in dealing with this so-called 'bureaucracy'. 

Remark 3.3. In the following, we assume that an empty conjunction can be represented 
by a nonempty conjunction of t units. 

Theorem 3.4. For every Gentzen derivation A with premisses (f>i, . . . , <ph and conclusion 

01 A ■ ■ ■ A 0/, 

ij/ there is a derivation o || SKSg ; ifn is the size of A, the size of O is 0(n~)," moreover, 
if A is analytic then <i> is in KSg. 

Proof. We proceed by induction on the tree structure of A. The base cases id — - and t — 

t A,A t 

are, respectively, translated into iJ, — - and t. The derivations 

A, A 

bi ... (ph (pi ... 4>h 

, and 
(j),A,A (p,A,B 
c ■ 




b,A 4>,AyB 
are, respectively, translated into 

01 A ■ • ■ A 0;, 

II 01 A • • ■ A 0, 

ti SKSg ^ ^ 01 A ... A 0,, 

1 ti SKSg , n 

^ > _! r ^ ^ n > and Oi SKSg 

= V [A V A] ' II M ' 

V f cl V [A V fi] 

wi V A 

V A 

where Oi is obtained by induction from Ai, and some possibly necessary instances of the 
- rule have been omitted (they depend on the exact translation of Gentzen multisets into 
SKSg formulae). The derivations 

01 . . . 0;, 0,,+ i ... 4>k 4>l ■■■ (/>h (ph+\ ■■■ <f>k 

A] / \^ Ai y \ A] / \^ Ai 

and 




,A aB,0 
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are, respectively, translated into 



il A • ■ ■ A 



(pi /\ ■ ■ ■ A (pk 
<I>1ACI)2 



Oiao, II _ V A] A [A V ip] 

[(^vA] A [Bv(/r] ~ [A V i/r] A [A V 

= s — = 

[g V i/r] A [A V (/)] and _ ([A vi/r] aA)v0 

([B V (/r] A A) V ~ V (A A [A V i/r]) 

~ V (A A [B V t/r]) ^ V [(A A A) V ^/r] 

it- 



<p V [{A A B) V tp] V [f V (^r] 

V 1^ 

where Oi and ^2 are obtained by induction from Ai and A2, some possibly necessary 
instances of the = rule have been omitted, and a <t)2 stands for the derivation 

(^1 A ■ ■ ■ A 0^ 

O|A(0,, + ,A.-A0i-) II 

[0VA] A(0,,_n A... A0t) , 

[0vA]Aa>2 II 

[0 V A] A [B V iff] 

where B is possibly instantiated by A; the length of this derivation and the size of the largest 
formula appearing in it are both 0(«). The resulting 0(«^) measure of these last two cases 
dominates the others. □ 

Corollary 3.5. SKSg p-simulates Gentzen and KSg p-simulates analytic Gentzen. 

Although it does not explicitly address complexity, pBru04l| is more exhaustive than the 
aforesaid on the two-way translation between SKSg and Gentzen. Translating from SKSg 
to Gentzen crucially employs the cut rule: for every inference step in SKSg, a cut instance 
is used in Gentzen. So, while it is very natural and easy to show that Gentzen p-simulates 
SKSg (see HBruMJ), we are left with the question: does analytic Gentzen p-simulate KSg? 

3.2. Analytic Calculus of Structures on Statman Tautologies. We prove here that an- 
alytic Gentzen does not p-simulate KSg. In fact, the CoS (polynomial) inefficiency in 
dealing with context bureaucracy is compensated by its freedom in applying inference 
rules, which leads to exponential speedups on certain classes of tautologies. Here, we 
study Statman tautologies, which have been used to provide the classic lower bound for 
analytic Gentzen systems: no cut-free proofs of Statman tautologies are possible in an- 
alytic Gentzen without the proofs growing exponentially over the size of the tautologies 
they prove IISta78l . We show that, on the contrary, KSg and KS prove Statman tautologies 
with polynomially growing analytic proofs. 

Remark 3.6. The subset of SKSg only containing analytic rules is equal to KSg plus 
the cocontraction rule. We do not know whether cocontraction provides for exponential 
speedups, so separating, proof-complexity-wise, the class of KSg from that of 'analytic 
CoS'; about this, see Problem 16.21 In our opinion, the very notion of analyticity would 
benefit from some further analysis; about this, see Problem [6.4l 

Definition 3.7. Forn > 1, consider the following formulae: 

Q'i = Ci V di for / > 1 , 

Pl = ^l^^a; = a„Al3l-' for«>fc>l, 
Yl^Pl^iAcu forn>k>\, 
6'l=/3l^iAdk forn>k>l. 
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Statman tautologies are, for « > 1, the formulae: 

S„ = a„ V [(y;;_, A V [. . . V [(y'Z A 6'1) V t^i ] ■ ■ •]] . 

Example 3.8. These are the first three Statman tautologies: 

51 = (Cl Ac/i) V [Cl V Ji] , 

52 = (C2 A dl) V [(([C2 V dl] A Cl) A ([C2 V J2] A dl)) V [Cl V Ji]] , 

53 = (C3 A di) V [(([C3 V J3] A C2) A ([C3 V J3] A c/2)) V 

[((([C3 V J3] A [C2 V J2]) A Cl) A (([C3 V J3] A [C2 V d2\) A dl)) V 
[ClvJi]]] . 

It is perhaps easier to understand their meaning by using implication, as in 

S3 = [C3 V J3] ^ ([([C3 V J3] ^ C2) V ([C3 V J3] ^ d2)] - 

([(([C3 V J3] A [C2 V dl]) ^ Cl) V (([C3 V J3] A [C2 V ^2]) ^ dl)] ^ 

[civJi])) . 

Remark 3.9. |S„| = 2 + 2 S^'ll |rl'| +2 = 2 ZLad^^l + D + 4 = 2«2 + 2. 

It is not difficult to see why analytic Gentzen proofs of Statman tautologies grow expo- 
nentially (this is a classic argument that can be found in many textbooks; see, for example, 
IICK02I ). Basically, all what analytic Gentzen can do while building a proof of S„ is to 
generate a proof tree with 0(2") branches. The next lemma shows the crucial advantage 
of deep inference over Gentzen systems: Statman tautologies can be proved 'from the in- 
side out', which is precisely what Gentzen systems can only do by resorting to convoluted 
proofs involving cuts (so, nonanalytic proofs). 

Remark 3.10. In the following, for brevity, we label inference steps with expressions like 
« ■ V, to denote n inference steps involving rule v. c 

Lemma 3.11. For Statman tautologies S„ and S„+i there exists a derivation || ks whose 
length is 0(n) and size is 0{n^). S„+i 

Proof. We refer to Definition l3.7l The requested derivation is 

(C„ A d„) V 

[((y8>c„_i)A(yS;;Aflf„_i))v[...v 
[((yS'^ACi)A(/3'^At/i))vai]---]] 



2« ■ ii 



2n ■ S 



(([a„+i V a„^i] A c„) A {[a„+i v a d^)) v 

[((([a«+i V a„+i] A^«) A c„_i) A ({[a„+i V a„+i] a/3") a d„-i)) v [■ ■ ■ v 

[(((bn+l V Q-„+l] A^«) A Cl) A (([a„ + l V a„+l] A/3") A dl)) V ffi] ■ ■ .]] 



<D = [ffn+l v[---v[q'„+i VQ'„ + i ]■■■]] V 

[((a„+i A c„) A (a„+i A d„)) V 

[(((a„+l A^;;) A C„_l) A ((ff„+i A/3«) A d„-l)) V [• ■ • V 

, [(((a«+iA;85)Aci)A((a„^i A^2)A£/i))vai]---]]] 
(2n - 1) ■ cj, 

[((ffB+l A C„) A («„+! A d„)) V 

[(((ff„+l AyS;;) A C„_l) A ((a„+i A/3") A d„-l)) V [• ■ • V 
[(((ff„+l AyS'^) A Cl) A ({a„^i A^«) A dl)) V ^l] ■ ■ •]]] 

where we use macro inference rules as explained in Remark l2.22l (Example l2. 14l explains 
the central step in the preceding derivation.) The formulae appearing in the middle of the 
previous derivation are the largest. Since \a„+i\ = 2 and |/3^'| = 2(n - k + 1), their size is 
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2n-2+6+2(3«-3 + 2t=2 l/^t'l)+2 - 2n^+8«+2. Each ij macro inference step involves one s 
and two aii steps in KS, for a total of six steps, including = ones; each ci macro inference 
step involves one m and two aci steps in KS, for a total of six steps. So, the length of <S> is 
2« ■ 6 + 2« ■ 2 + (2n - 1) ■ 6 = 28n - 6, and so |(D| < (28« - 6)(2n^ + 8n + 2) e O(n^). □ 

Note that in the previous proof, by working with macro inference rules, we get a better 
upper bound for KS than if we worked in KSg and then applied Theorem l2.22l 

Theorem 3.12. There are KS proofs ofStatman tautologies whose size is quadratic in the 
size of the tautologies they prove. 

Proof. Tautology Si is trivially provable by an instance of the iX macro rule. By repeatedly 
applying the previous lemma, we obtain proofs of all Statman tautologies S„, whose size 
is 0(11"). Since |S„| 6 0(«^) (see Remark [T9] l. the statement follows. □ 

This is enough to conclude that analytic Gentzen does not polynomially simulate KSg 
and KS. Some could argue that Statman tautologies are artificial in their forcing exponen- 
tial Gentzen proofs into 'wildly' branching. However, notice that both notions of proof 
and analyticity in Gentzen systems 'get into tautologies' from the outside inwards. In 
other words, the restricted notion of analyticity in Gentzen systems is strongly correlated 
to the restricted notion of proof that leads to exponential-size proofs. In CoS, both notions 
are more liberal, to the advantage of proof complexity. We pay a price for this in terms 
of proof-search complexity: there is research aimed at improving the situation, with very 
promising results; see IIKah06al . 

We note that polynomial proofs on Statman tautologies are obtained by a very small 
dose of deep inference. In fact, the trick is done by the switch and interaction instances in 
the proof in Lemma [3.11l they all operate just below the 'surface' of a formula. This leads 
us to state a currently open problem, in Section l631 

4. Calculus of Structures and Frege Systems 

In this section, we prove that CoS and Frege systems are p-equivalent. 
In the following definitions about Frege systems, we do not assume that the language of 
formulae coincides with the CoS one, but, as always, this is not a very important issue. 

Definition 4.1. Given a language of propositional logic formulae built over a complete 
base of connectives, a Frege {proof) system is a finite collection of sound inference rules, 
each of which is a tuple of « > formulae such that from n - 1 premisses one conclusion 
is derived; inference rules with premisses are called axioms. Given a Frege system, a 
Frege derivation of length I with premisses a\, . . . , and conclusion /3i is a sequence of 
formulae /3], . . . ,/3i, such that each y6, either belongs to {ai , . . . , a/,] or is the conclusion of 
an instance of an inference rule whose premisses belong to /3], . . . ,j6,-i, where I < i < I; 
a Frege proof of j6 is a Frege derivation with no premisses and conclusion /3; we use T for 
derivations. We require of each Frege system to be implicationally complete, i.e., whenever 
(ai A • • • A Oh) ^ >S is valid there is a derivation with premisses ai, . . ., ai, and conclusion 
P in the proof system. The size of a Frege derivation T is the number of unit, atom, and 
variable occurrences that it contains, and is indicated by |T|. 

The following 'robustness' theorem can easily be proved. 

Tlieorem 4.2. {Robustness, Cook-Reckhow, IICR79I ) All Frege systems in the same lan- 
guage are p-equivalent. 

The theorem has been generalised by Reckhow to Frege systems in any language (under 
'natural translations') IIRec76l . but we do not need this level of generality in our article. 
The robustness theorem allows us to work with just one Frege system, and we arbitrarily 
choose the following, taken from IIBus87ll and modified by adding axioms F14, F15, Fie, 
and Fi7 in order to deal with units. 
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Axioms: 


Fii 


= (A 




F, 




F12 


s (A 


^(B^C))^(B- 




s (A A B) ^ A 


Fl3 


s (A 


^ B) ^ (-B ^ -A) 




s (A A B) ^ B 


Fl4 


B f ^ 


(A A ^A) 


F4 


s A ^ [A V B] 


Fl5 


= (A 


A -A) ^ f 


rs 




' 16 


= t ^ 


FA V Ml 


F6 


B --A ^ A 


Fl7 


= [A 


V M] ^ t 


F7 


s A ^ --A 








Fg 


s A^(B^A) 






Inference rule: 


Fg 
Fio 


s -A ^ (A ^ B) 

= (A-(B-C))-((A-B)-(A-C)) 






A A^B 

mp 

B 



Figure 5. System Frege. 



Definition 4.3. Frege system Frege, over the language of formulae freely generated by 
units, non-negated formula variables, and the connectives v, a, ^, and ^, has inference 
rules as shown in Figure|5] where the formulae Fi, . . . , Fn are axioms and the inference 
rule mp is called modus ponens. 



Remark 4.4. In the following, every SKS formula is implicitly translated into a Frege 
formula in the obvious way, and vice versa; in particular, we translate Frege's formulae of 
the kind a ^ p into SKS formulae a v 

Remark 4.5. In Frege systems, distinguishing atoms from formula variables is unnec- 
essary because we only instantiate rules by general substitution (as opposed to renam- 
ing). So, from now on, we assume that CoS atoms correspond to Frege formula vari- 
ables. Since in system Frege we have a connective for negation, we can also assume that 
when dual atoms and formula variables appear in an SKSg formula, their Frege translation 
only uses ^; for example, the SKSg formula [A v A] a [« v 5] is translated into Frege for- 
mula [A V ^A] A [B V ^B] or [A v ^A] a [-B v B] or [-A v A] a [B v ^B] or [-A v A] a [^B v B]. 
Conversely, Frege formula [A v M] a [B v ^B] is translated into SKSg or SKS formula 
[a V a] A [Z? V b\ or [a v 5] a [I? v b] or [a v a] a v b} or [a v a] a [I? v b] or one such for- 
mula with formula variables in the place of some of the atoms. As always, we use atoms 
when we need to use SKS atomic structural rules, we use formula variables when we need 
to instantiate formulae and derivations, and otherwise we can choose both. 

Translating Frege into SKSg derivations is straightforward, given that the cut rule of 
SKSg can easily simulate modus ponens. 

Tlieorem 4.6. For every Frege derivation T with premisses a\, .. ., a/,, where h > 0, and 

ai A ■ ■ ■ A a/, 

conclusion /3, there is a derivation <t || SKSg ; /// and n are, respectively, the length and 

P 

size of Y, then the length and size of O are, respectively, 0(1) and 0(n''). 



ON THE PROOF COMPLEXITY OF DEEP INFERENCE 



17 



Proof. The axioms F, of Frege are tautologies, so each one has a proof <1), in SKSg, for 
1 < J < 17; for example Fi and Fio are, respectively, proved by 

t 

ii 



(Aa(BaC))v[Av[BvC]] 



t (AA(BAC))v[Av[(BAt)vC]] 
ii^ — = ii- 



A V [B V (A A B)] 

Ci 



(A 


a(B 


aC))v 


[Av[(Ba[AvA]) 


vC]] 


(A 


a(B 


aC))v 


[A V [[(BaA)vA] 


vC]] 


(A 


a(B 


aC))v 


[(A aB) V [[A vA] 


vC]] 



(A A (B A O) V [(A A B) V [A V C]] 

We proceed by induction on the length of T - /3i, . . . ,/3k,/3 and we prove the existence 
ai A ■ ■ ■ A a/, 

of a derivation o' || SKSg . The base case A: = is as follows: 1) if /? is a premiss, 

(A A---A/?i)A^ 

then <!>' - (3; 2) if [5 = F,cr, for some / and cr, then = <[),(t. For the inductive step, 

Jk 

given Tj: - /3u ■ ■ ■ ,Pk and o^. || SKSg , where is the conjunction of premisses of T^., we 
y6i A... A^e^ 

consider the following cases: yf. a /3 

II 

• if yS is a premiss, then = oJ a^s || sKSg ; ^, || g|^gg 

A...A^i)A/3 p^A.-.APk 

• if B = F,cr, for some / and substitution o", then O' = = ; 

08l A...A^,)At 

(/J|A...A/3i.)A<l),.o-||sKSg 

(y6l A... A/3^)A^ 

• if y6 is the conclusion of an instance mp , where A" = ^ P and 

I <k\k" <k,t\ien ^ 

7k 

t;, II SKSg 

^1 A ■ ■ ■ AyS^„ A ■ ■ ■ A/3t 



cT- 



j6l A • ■ ■ A/?^, A ■ ■ ■ A (j8t„ A/3k") A ■ ■ ■ A/3i 

cT 

(5' = _ A • • . A (y?^, A^j.,) A • . • A (jS^„ A^j„) A---A/3k , 
~ Qgl A.--A/j^)A06^, a[A>vA) 

(ygl A---A/j^.)A[(/j^, aAQvA 

_ 08l A...A/j,)A[fv^] 
(J3lA---A/3k)AP 

where, without loss of generality, we assumed k' < k". 
At every inductive step the length of the SKSg derivation is only increased by an 0(1) 

ai A ■ • ■ A Q-;, 

number of inference steps. From o' || SKSg we can obtain the desired derivation 

Q-I A • ■ ■ A a/, (y8l A ■ • ■ A A ^ 

o II SKSg by applying once the wt rule. So, the length of O is 0(k). From this, and after 
P 

inspecting the aforesaid derivations, it follows that |<1>| € 0(k^m), where m is the maximum 
size of a formula appearing in T, and so |<1)| e O(n^), where |T| - n. □ 

Corollary 4.7. SKSg and SKS p-simulate Frege. 
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Proof. The statement for SKSg follows from Theorem l4.6l and that for SKS from this and 
Corollary |Z23] □ 

Translating derivations from SKSg to Frege requires more effort than the converse, 
partly because of the need to simulate deep inference, and partly because of the large 
'amount of inference' of =-rule instances. The next two lemmas take care of these two 
issues. 

Lemma 4.8. For every SKS context ^{ } and formulae a and f}, there is a Frege derivation 
with premiss a^fi and conclusion ^{a}^^y3] whose length is 0(m) and size is O(n^), where 
m = |^{ ]\andn^\^{a}^m\- 

Proof. Consider four Frege proofs Y', Y", Y'", and Y"", respectively of the four tautolo- 
gies 

(A-B)^([AvC]^[BvC]) , (A^B)^([CvA]^[CvB]) , 

(A^B)^((A aC)^(BaC)) , (A^B)^((CaA)^(C aB)) . 

We proceed by induction on the structure of ^{ ). If ^{ ) s j v yj), we build Frege 
derivation 

Yi = ff^yS, Y'{A/a,B//?,C/ri},Q' vyi ^/?vyi ; 

we build Yi similarly if ^{ } = ) Ayi) or ^{ ] = ^Aji v { }} or ^{ ] = fiin a { }}. 
Given fi{ } = ^2{{ } vyi) or ) = ]^72] or ) = ^2(72 v { )) or ) = 
^2(72 ^ { }} we build Y2 analogously to Yi, and the premiss of Y2 is the conclusion of 
Yi. We proceed this way until we build Y/, whose conclusion is ^{a] ^{/?}, where I < m. 
We obtain the desired derivation Y by concatenating Yi, . . . , Y/. Since the length and size 
of Y', Y", Y'", and Y"" are independent of ^{ }, a, and /3, the length of Y is 0(ot) and its 
size is 0(mn), and so O(n^). □ 

Lemma 4.9. For every SKS fonnulae a and p such that a - p there is a Frege derivation 
with premiss a, conclusion /3, length 0(n^), and size 0{n'^), where n — \a\ + \/3\. 

Proof. Consider the following tautologies, derived from the equations in Figure[T] 

[A V B] « [fi V A] , [A V f] « A , 

(AAfi)«(BAA) , (AAt)«A , 

[[AvB] vC]«[Av[BvC]] , [tvt]«t , 

((A aB) aC)«(A a(BaC)) , (fAf)«f , 

where each expression corresponds to the two tautologies obtained by orientating each 
double implication. Every such tautology can be proved in Frege with a constant-size 
proof, so every instance y ^ y' of any of these tautologies has a Freg e proof of length 0(1) 
and size O(m'), where m' = |y| + |y'|. By Lemma l4~8l for every ^{ } there is a derivation 
with premiss y ^ y' and conclusion ^{y) ^ ^{y') whose length is 0(m) and size is O(m^), 
where m - |^{y} ^ ^{y'}|. By concatenating the proof and derivation so obtained, we can 
build a proof of ^{y) ^ ^{y'} whose length is 0(m) and size is O(m^). By Remark IZ91 we 
can build a chain of implications 

asai^ >ai,s6s/3k^ >/3i=/3 , 

where (5 is a canonical form for a and /3, h + k is O(n^), and each implication a, ^ o-j+i and 
yS,+i ^ Pi is a tautology of the form ^{y) ^ ^{y'), such that y ^ y' is an instance of one of 
the tautologies [1] By concatenating the proofs of every ^{yj ^ ^{y'l by mp, we obtain a 
derivation with premiss a, conclusion f3, length 0(«^), and size 0(«"^). □ 

a 

Lemma 4.10. For every inference step v — , where v is a rule of SKSg, there is a Frege 
derivation with premiss a, conclusion length 0(«), and size 0(«^), where n - \a\ + 
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Proof. Each of the following tautologies, corresponding to the inference rules in Figure |2] 
can be proved in Frege with a constant-size proof: 

(AA^A)^f , A-t , A^(AaA) , 

(2) f^[Av^A] , f-A , [AvA]^A , 

(A A [B V C]) ^ [(A A B) V C] . 

a ^{y) y 
Let V — = V , where v — is an instance of v. There is a Freqe proof T of y ^ 5, 

/? ^[5\ 6 

whose length is 0(1) and size is 0(n), obtained by instantiating the corresponding proof to 
V among those in|2] By Lemma l4~8l there exists a Frege derivation T' with premiss y 6, 
conclusion ^{y] ^[6], length 0(n), and size 0(«^). By concatenating Y and T' we obtain 
a proof Y" of ^{y} ^{6]. From Y", by using mp, we obtain the desired derivation with 
premiss a = ^[y] and conclusion/? = ^[6]. □ 



Theorem 4.11. For every derivation o||sKSg there is a Frege derivation Y with premiss 

P 

a and conclusion f3; if n is the size of O, then the length and size of Y are, respectively, 
Oin"^) and O(n^). 

Proof. The statement immediately follows from Lemmas I4.9l and l4.10l after assuming that 
the length of O is 0(«). □ 

Corollary 4.12. Frege p-simulates SKSg and SKS. 

Remark 4.13. As evidenced by the proofs of Theorems 14.61 and 14. Ill it does not really 
matter, for establishing the p-simulations, precisely which inference rules are adopted by 
the CoS and Frege systems. In fact, the simulations work because the simulating systems 
are implicationally complete and their set of proofs is closed under substitution. This way, 
the constant-size proofs in one system, simulating the rules of the other system, can be 
instantiated at a linear cost in order to simulate instances of rules. We can then use a ro- 
bustness theorem (see Theorem 14.21 ) for Frege in order to establish a robustness theorem 
for CoS, possibly also for systems on mutually different languages: given two implication- 
ally complete CoS systems, we p-simulate each in two appropriate Frege systems and use 
Frege robustness. 

5. Extension and Substitution 

In this section, we show how CoS systems can be extended with the Tseitin exten- 
sion rule and with the substitution rule, analogously to Frege systems. We also show the 
p-equivalence of all these systems, as described in the box of the diagram in the Introduc- 
tion. As always, we operate under robustness theorems (relying on the mentioned one, 
Theorem l4.2l) that ensure that the proof complexity properties we establish for the specific 
systems actually hold for the formalisms they belong to. 

Definition 5.1. An extended Frege (proof) system is a Frege system augmented with the 
(Tseitin) extension rule, which is a rule with no premisses and whose instances A ^ /3 are 
such that the variable A does not appear before in the derivation, nor appears in /3 or in 
the conclusion of the proof. We write A i a to state that variables A and A do not appear 
in formula a. The symbol « stands for logical equivalence, and the specific syntax of the 
expressions A ^ /3 depends on the language of the Frege system in use. In the following, 
we consider A "y6 a shortcut for (A a (^6 ^ A). We denote by xFrege the proof system 
where a proof is a derivation with no premisses, conclusion aic, and shape 

ail = o^k = 

ai, ■ ■ ■,a'/|-i, Ai «j6i ,a,|+i, . . . ,a/,-i, A/, «j8/, , a/,,+i, .. .,ak , 
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where all the conclusions of extension instances ai^, . . . , cr/,^ are singled out and 

Ai iau--.,ai^-i,/3i,ak , ... , A/, ^ ai, . . . , a,, _!,/?/,, , 
and the rest of the proof is as in Frege. 

Remark 5.2. We could have equivalently defined an xFrege proof of a as a Frege deriva- 
tion with conclusion a and premisses {Ai "y6i, . . . , A/, « /3i,] such that Ai, Ai, . . . , A/,, A/, 
are mutually distinct and Ai i I3\,a and . . . and A/, i /3i,. . . ,Ph, Notice that xFrege 
is indeed a proof system in the sense that it proves tautologies. In fact, given the xFrege 
proof just mentioned, we obtain a Frege proof by applying to it, in order, the substitutions 
c;, - AhlPh, . . . , o"! = AilPi, and by prepending to it proofs of the tautologies Pi « j3\, 
(fi2^P2)cr\, . . . , (J3i,^/3i,)o-ij-i ■ ■ ■ cTi. In general, a proof so obtained is exponentially bigger 
than the xFrege one it derives from. 

SKSg can analogously be extended, but there is no need to create a special rule; we 
only need to broaden the criterion by which we recognize a proof. 

Definition 5.3. An extended SKSg proof of a is an SKSg derivation with conclusion a 
and premiss [A] v/Jj] a [jfii v Ai] a . . . a [A/, v /?;,] a [j3i, v A/,], where Ai, Ai, . . . , A/„ A;, are 
mutually distinct and A 1 ^ j6i,q' and . . . andA/, i fix, . . . ,j3h,a- We denote by xSKSg the 
proof system whose proofs are extended SKSg proofs. 

Tlieorem 5.4. For every xFrege proof of length I and size n there exists an xSKSg proof 
of the same formula and whose length and size are, respectively, 0{l) and O(n^). 

Proof. Consider an xFrege proof as in Definition 15. II By Remark Isl and Theorem 14.61 
there exists the following xSKSg proof, whose length and size are yielded bv l4.6l 

[Al Vj8i] A V Al] A . . . A [Ah V^;,] A V A,,] 
II SKSg 

ak 

□ 

Although not strictly necessary to establish the equivalence of the four extended for- 
malisms (see diagram in the Introduction), the following theorem is very easy to prove. 

Tlieorem 5.5. For every xSKSg proof of size n there exists an xFrege proof of the same 
formula and whose length and size are, respectively, 0(n'*) and 0(«^). 

Proof. Consider an xSKSg proof as in Definition 15.31 The statement is an immediate 
consequence of Theorem l4.11l after observing that there is an 0(/!)-length and 0(/i«)-size 
xFrege proof 

Al «/3i,...,A,,«yS,„...,(A, «j6i)A...A(A/,«y8,,) . 

□ 

Corollary 5.6. Systems xFrege and xSKSg are p-equivalent. 

We now move to the substitution rule. 

Definition 5.7. A substitution Frege {proof) system is a Frege system augmented with 
A 

the substitution rule sub — . We denote by sFrege the proof system where a proof is a 
Acr 

derivation with no premisses, conclusion a^, and shape 

»/, = Ok = 

ai,.. . ,a,i-i, aj.cri ,a;,+i, . . . ,a,-,,-i, aji^crh ,ai,,+i, ...,ak , 

where all the conclusions of substitution instances a,j , . . . , are singled out, aj^ e 
{ai, . . . , o'li-i}, ■■ ■,aji, e {ai, . . . , a,,,-i), and the rest of the proof is as in Frege. 
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We rely on the following result. 

Theorem 5.8. (Cook-Reckhow and Krajfcek-Pudlak. ||CR79l|KP89l ) Systems xfrege 
and sFrege are p-equivalent. 

We can extend SKSg with the same substitution rule as for Frege. The rule is used like 
other proper rules of system SKSg, so its instances are interleaved with =-rule instances. 

Definition 5.9. An sSKSg proof is a proof of SKSg where, in addition to the inference 
steps generated by rules of SKSg, we admit inference steps obtained as instances of the 
A 

substitution rule SUb . 

Act 

This rule does not fit any of the usual deep-inference rule classes (see Section|2]), and (as 
in Frege systems) is not sound, in the sense that the premiss does not imply the conclusion. 
However, of course, if the premiss is provable the conclusion also is. 

Remark 5.10. Notice that instances of the substitution rule cannot be used inside a context; 
for example, the expression on the left is not a valid sSKSg proof, while the one on the 
right is: 

t t 

ii = ii 

A V A , A V A 

sub? sub- 



(B A C) V A (B A C) V [B V C] 

In the so-called 'Formalism B' of deep inference, which is currently under development 



|Gug04), and for which all the proof-complexity results in this article apply unchanged. 



substitution becomes part of the composition mechanism of proofs, rather than an odd 
extension to the set of rules. 

For the time being, we can establish the promised p-equivalence of all extended systems 
by completing the diagram in the Introduction with the last two missing steps. 

Tlieorem 5.11. For every xSKSg proof of size n there exists an sSKSg proof of the same 
formula and whose length and size are, respectively, 0(n) and O(n^). 

Proof. Consider the xSKSg proof 

[Ai Vj8i]a[j8i vAi]a---a[A,, Vje;,]A|je,, vA,,] AliPua , 

o II SKSg , where 

a 

and let us call its premiss y. We can build the sSKSg proof 

t 



Ah i/3i,...,/3h,a 



sub 



ii- 

y V y 
yvd) II SKSg 

[(Ai A^i) V (^1 A Ai) V ■ ■ ■ V (A/, A/3h) V (fih A A/,)] V a 

[(Al A^i) V (/?! A Al) V ■ ■ ■ V (/j/, Afth) V (fil, A^,,)] V a 
^ [(Al A^i) V (^1 A Al) V . . . V (^/, Aj6,,)] V a 

It 

[(Al AySi) V (j8i A Al) V ■ ■ ■ V f] V a 



sub 
ci 



[(Al 


AjSl) 


^(J3i 


A Al)] V a 


m 


aA) 




Ay8l)] vc 




t — 


AySl) 


V a 



f V, 
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Corollary 5.12. sSKSg p-simulates xSKSg. 

Theorem 5.13. For every sSKSg proof of size n there exists a proof of the same formula 
in sFrege, whose length and size are, respectively, 0(«^) and 0{n^). 

Proof Every sSKSg proof has shape 

t 

<to II SKSg 

sub 



aiCTi 

ti II SKSg 

0,,_, II SKSg 
, ah 

sub 

II SKSg 
C/i+l 

By Theorem l4.1 II for each of Oq, ■ ■ ■ , there exist Frege derivations To, . . . , T/, with 
the same premiss and conclusion, respectively. We can then build the proof 

To T, T,,_, T,, 



. . . ,^1 , aiCTi, . ...,0!h, ai,o-i„ . . .,«/,+! 

in sFrege; the cited theorem also yields its length and size. □ 

Corollary 5.14. sFrege p-simulates sSKSg. 

Nothing prevents us from using Tseitin extension and the substitution rule with system 
SKS, or any other atomic or nonatomic CoS system. The integration of these mechanisms 
into CoS is similar to their integration into Frege systems, as the simplicity of the argu- 
ments showing p-equivalence testifies. 

6. Open Problems 

We conclude the article with a list of open problems, some of which are currently in- 
vestigated by us and other researchers. 

6.1. Relation with Resolution and Other Formalisms. In this article, we explored the 
relation between CoS and Frege systems, and in the cited literature the relation between 
CoS and Gentzen systems has been explored in depth. There are, of course, other for- 
malisms, like resolution, whose relation with CoS might lead to some interesting research 



directions. For example, the note |Gug03| shows how simply, compared to Gentzen sys- 



tems, KS expresses resolution (analytically, of course). 

6.2. Does Cocontraction Provide for an Exponential Speedup? As we argued in Re- 
mark l3.6l we do not know whether KSg p-simulates KSg U (ct), or, equivalently, whether 
KS p-simulates KS U {act). 

Our intuition, as well as some clues, hke the mutual behaviour of the 'atomic flows' 
of contraction and cocontraction (see IIGG08II ) would lead us to believe that cocontraction 
indeed provides for an exponential speedup. However, we know that in similar situations, 
like for dag-like versus tree-like Frege systems, intuition was fallacious. 

If cocontraction yields an exponential speedup, we obtain an even stronger analytic 
system than KSg, which is, in turn, stronger than analytic Gentzen. This would draw 
interest to a hierarchy of analytic proof systems of different strength. 
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Unless we prove the p-equivalence of KSg and KSg U {cTK we tend to consider cocon- 
traction a simple rule-based mechanism for compressing proofs, like cut, extension, and 
substitution. 

6.3. Pigeonhole in Analytic CoS. Does the pigeonhole principle, in particular in its rela- 
tional variety, admit polynomially growing proofs in KS? If not, does it in KS U {act}? 

Investigating this problem could be relevant to the more general, following one (Prob- 
lem |631), about the ability of analytic CoS to simulate CoS, and so Frege. In fact, the 
pigeonhole principle generates some of the hardest classes of tautologies known. 

We note that in |Jap08[ , Japaridze shows polynomially growing proofs for the pigeon- 
hole class of tautologies in a deep-inference system over certain circuit-like sequents, 
called 'cirquents'. In this case, the speedup is obtained by the sharing of logical expres- 
sions in circuits. 

In ||Jef09l . Jefabek shows that there are polynomial- time constructible proofs in KS U 
{act) of the functional and onto variants of the pigeonhole principle. 

6.4. Relative Strength of Analytic CoS and CoS. Some recent major progress has been 
made in IJef09.l . There, Jefabek uses a construction on threshold formulae in the mono- 
tone sequent calculus, by Atserias, Galesi and Pudlak IIAGP02L to show that analytic CoS 
quasipolynomially simulates CoS. In IIBGGP09L we provide a direct and simplified con- 
struction based on atomic flows IIGG08I and threshold formulae. 

Because of these recent advances, we expect that analytic CoS p-simulates CoS. A more 
in-depth discussion of this subject is in IIBGGP09II . If analytic CoS p-simulates CoS, then 
there are polynomially growing proofs of the pigeonhole principle in analytic CoS, though 
not necessarily in KS. 

We think that investigating this problem will help us to better understand analyticity, in 
order to obtain for it a general and more useful definition than the one we have now. We 
feel that the current notion is not satisfactory because it depends on the formalism and must 
be defined by resorting to the syntactic structure of inference rules (or, worse, by indicating 
which rules are analytic and which are not). 

For example, a more general, nonsyntactic definition of analyticity could be the follow- 
ing: a rule is analytic if, given an instance of its conclusion, the set of possible instances 
of the premiss is finite (this is what we call a finitely generating rule in Section|2li. In this 

^{a A a] 

sense, an atomic 'finitary' cut rule fait — ^^-j — , such that a appears in ^{ ), would be ana- 
lytic. However, IIBG04I shows that we can easily transform proofs in SKS into smaller- or 
equal-size proofs that only use fait wherever ait was used. So, we could deem fait an ana- 
lytic rule, and the system obtained from SKS by substituting ait with fait an analytic one, 
and we could immediately conclude that analytic CoS p-simulates CoS. This 'solution', 
however, is way too cheap. 

We prefer to think that fait is not an analytic rule, in some sense to be made precise. A 
possible point of attack is offered by the fact that fait is not a local rule: it requires checking 
that a appears in its context, whose size is unbounded (see Remark 12.171 ). So, we think it 
could be productive to look for a notion of analyticity that is based on boundedness instead 
of finiteness, and tackle the separation problem between analytic CoS and CoS under that 
notion. The note IIBG07II further explores this direction, but much more work is necessary. 

6.5. Strength of Analytic CoS Systems Plus Substitution. We showed that CoS and 
Frege systems are p-equivalent, and both remain p-equivalent when extended either with 
Tseitin extension or substitution. However, CoS is more flexible than Frege, because it 
allows to 'switch off' two mechanisms that potentially provide for an exponential com- 
pression of proofs: cut and cocontraction (see Problem [6.2l ). 

It might be interesting to study the relative strength of systems obtained by removing 
from SKS U {sub} either ait or act or both. (Rule awt can also be removed, but we do 
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not see a crucial role for it.) Notice that systems KS U {sub} and KS U {act, sub} could be 
considered, in some sense, analytic, and we do not know their relative strength. 

6.6. Speedup of Deep Inference Over Any Bounded-Depth System. We saw in The- 
orem 13.121 that analytic CoS exhibits an exponential speedup over analytic Gentzen, for 
Statman tautologies. We argued that, in this case, the speedup is obtained by a rather triv- 
ial use of deep inference, because the depth at which inference has to be performed, in 
order to get the speedup, is constant. So, a natural question is whether there exists a class 
of tautologies that requires full-fledged deep inference in order to obtain efficient proofs. 
We think we found such a class, which is defined as follows. 

Consider, for every propositional formula a, the following set of second-order formulae, 
for n > 0: 

= VyS.[((aA/3)A/?)v(^A^)] , 
g{n + l,a) = 'i/3.[ig{n,aA/3)Ag{n,p)) v ig{n,^) a g{n,m ■ 

By using these formulae as a template, we can generate a set of first-order formulae, where 
the (complex) management of indices ensures their uniqueness: 

Definition 6.1. Consider, for m,n >0 

h{\,m,a) = {{a f^Prn+l) f^Pm+l)'^ (Pm+\ ^A«+l) ' 
h{n + 2, m, a) = {h(n + 1, ;7Z, a a Py*)+,„) a h{n + 1,5" + m,f5y+i+,„)) v 

(h(n + 1,2-5"+ m,y85„+i+„,) a h(n+ 1,3- 5" + ot,^5„+i+,„)) . 

Consider now 

f{n) = h{n,0,\) , for«>0 . 
We define the set DT - { fin) | « > }. 

The program |Gug07a| can help in understanding the nature of these formulae. 

Remark 6.2. It is not difficult to verify that DT contains tautologies possessing analytic 
CoS proofs that grow polynomially in the size of the tautologies. 

The analytic CoS proofs of the DT tautologies, when read bottom-up, work by applying 
interactions starting from the deepest subformulae. When this cannot be the case, we 
conjecture that the size of the proofs grows exponentially. 

Definition 6.3. The and/or depth of a formula is the maximum number of alternations of 
conjunctions and disjunctions in the formula tree; the and/or depth of a context ^{ } is the 
number of alternations of conjunctions and disjunctions between the hole and the root of 
the context tree. We define a bounded-depth CoS proof system as a CoS proof system 
whose inference rules only generate inference steps at a bounded depth, namely inference 

steps V are such that, if v — is a rule instance then the and/or depth of ^{ } is bounded 

by a given constant, and the same restriction holds for the contexts in the context closure 
condition of relation =. 

Remark 6.4. Note that the nonatomic rules interaction (identity), cointeraction (cut), 
contraction and cocontraction require establishing duality or identity of formulae of un- 
bounded and/or depth. So, their adoption might be considered an implicit use of deep in- 
ference. However, the atomic counterparts of these rules do not suffer this problem because 
the 'deep checking' is delegated to the inference mechanism. For this reason, proving the 
following conjecture is better done in the analytic part of system SKS. 

Conjecture 6.5. In any analytic bounded-depth CoS proof system, the tautologies in DT 
only have proofs that grow exponentially in their size. 



ON THE PROOF COMPLEXITY OF DEEP INFERENCE 



25 



7. Conclusion 

In this article, we showed that the calculus of stractures (CoS) has the same character- 
istics of the Frege formalism in terms of proof complexity, including when extended with 
Tseitin extension and substitution. 

We know that, contrary to Frege, CoS has a rich proof theory, and its proof systems 
enjoy several properties, arguably relevant to proof complexity, that cannot be observed in 
other formalisms, like locality for all inference rules. We also know that other logics, Uke 
modal logics, enjoy simple and modular presentations in deep inference, which should help 
in proof complexity investigations. This article establishes the basic connection between 
proof theory in deep inference and proof complexity. 

As a consequence of its flexibility in inference rule design, CoS admits a notion of 
analyticity that is more flexible than its counterpart for Gentzen systems. We can then 
explore the strength of analytic systems in finer detail than possible in Gentzen systems. In 
this article, we moved forward the boundary between polynomial and exponential analytic 
proofs by proving Statman tautologies with polynomial, analytic deep-inference proofs. 

We included a list of open problems and currently active research directions. 

Acknowledgements. We thank Tom Gundersen and Ozan Kahramanogullari for having 
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